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Abstract 

The Douglas-Rachford algorithm is a classical and very successful splitting method 
for finding the zeros of the sums of monotone operators. When the underlying oper¬ 
ators are normal cone operators, the algorithm solves a convex feasibility problem. In 
this paper, we provide a detailed study of the Douglas-Rachford iterates and the cor¬ 
responding shadow sequence when the sets are affine subspaces that do not necessar¬ 
ily intersect. We prove strong convergence of the shadows to the nearest generalized 
solution. Our results extend recent work from the consistent to the inconsistent case. 
Various examples are provided to illustrates the results. 
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1 Introduction 


Throughout this paper 

X is a real Hilbert space, 

with inner product (•, •) and induced norm 11 • 11. A (possibly) set-valued operator A : X 
X is monotone if any two pairs (x, u) and (y, v) in the graph of A satisfy {x — y,u — v) > 0, 
and is maximally monotone if it is monotone and any proper enlargement of the graph of 
A (in terms of set inclusion) destroys the monotonicity of A. Monotone operators play an 
important role in modem optimization and nonlinear analysis; see, e.g., the books HSj, BH, 

Eoi, m. HU, m. HU, im, and m- 


Let A : X X be maximally monotone and let Id : X —> X be the identity operator. 
The resolvent of A is Ja ■= (Id +A)~^ and the reflected resolvent is Ra ■= '2-Ja — Id. It is 
well-known that Ja is single-valued, maximally monotone and firmly nonexpansive. 


The sum problem for two maximally monotone operators A and B is to find x G X 
such that 0 G Ax -|- Bx. When (A -|- B)“^(0) 7 ^ 0 one approach to solve the problem 
is the Douglas-Rachford splitting technique. Recall that the Douglas-Rachford splitting 
operator BUI for the ordered pair of operators (A, B) is defined by 


( 1 ) T^a,b) ■= iild+RBRA) =ld-jA + JbRa- 


Let xq G X. When {A + B) ^ (0) 7 ^ 0 the "governing sequence" (T”^ b)^o)w€N produced by 
the Douglas-Rachford operator converges weakly to a point in Fix T^a,b) ^ (see BUI) and 


the "shadow sequence" {JaT^ab)^^^^^^ converges weakly to a point in (A -|- B) ^0. For 
further information on the Douglas-Rachford algorithm, we refer the reader to BTTl . B2TI . 
BZZi, and also B5| . 


When A := Nu and B := Ny where U and V are nonempty closed convex subsets of 
X, the sum problem is equivalent to the convex feasibility problem: Find x G Lf n R. In 
this case, using BS Example 23.4], 


( 2 ) T := F(Ny,Ny) = Id -Pu + PyRu, 

where Ru = 2Pu — Id. In the inconsistent case, when U (1 V = 0, the governing sequence 
is proved to satisfy that ||T”x|| —> -|-oo and the shadow sequence {Pi[T^x)n^fq remains 
bounded with the weak cluster points being the best approximation pairs relative to U 
and V provided they exist (see BSI)- 

^Fix T = |xeX|x = Tx}is the set of fixed poinfs of T. 

^Throughouf fhe paper we use Nq and Pq fo denofe fhe normal cone and projector associafed wifh a 
nonempty closed convex subset C of X, respectively. 
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Unlike the method of alternating projections, which employs the operator PyPu^ the 
Douglas-Rachford method is not fully understood in the inconsistent case. Nonetheless, 
the Douglas-Rachford operator is used in ||8l to define the "normal problem" when the orig¬ 
inal problem is possibly inconsistent. In this case the set of best approximation solutions 
relative to U (which are also known as the normal solutions, see IBl) is Lf n (v -|-U), where 
= t^fan(id -T)0- It is natural to ask what can we learn about the algorithm in the highlight 
of the new concept of the normal problem. 

The goal of this paper is to study the case when U and V are closed affine subspaces 
that do not necessarily intersect. The Douglas-Rachford method for two closed affine 
subspaces has recently shown to be very useful in many applications, for instance, the 
nonconvex sparse affine feasibility problem (see llTSlI and lUgl l and basis pursuit problem 
(see my Our results show that the shadow sequence will always converge strongly to a 
best approximation solution in Lf n (v -|-U) and therefore we generalize the main results 
in 113. This is remarkable because we do not have to have prior knowledge about the 
gap vector v; the shadow sequence is simply (PljR”^o)w€N- proofs critically rely on 
the well-developed results in the consistent case in ||3l and the structure of the normal 
problem studied in |j8l. 

We are now ready to briefly summarize our main results: 


R1 We compare the sequences ((_vT)”x)„g]N, ((T-v)”x)„g]N 
when T is an affine nonexpansive operator and v := 


prove that the three sequences coincide (see Theorem 3.2). Surprisingly, when we 
drop the assumption of T being affine, the sequences can be dramatically different 


1^ and (r”x + nv 
-0 G ran(Id — T) ^ 


weN 

We 


(see Example 3.3). 


R2 We prove the strong convergence of the shadow sequence (Plt r”xo)w6N when U 
and V are affine subspaces that do not have to intersect (see Theorem 4.41. We 


identify the limit to be the best approximation solution; moreover, the rate of con¬ 
vergence is linear when Lf -|- U is closed. 


R3 In view of R2 it is tempting to conjecture that the shadow sequence (/y^r”xo)w6N 
in the inconsistent case (i.e., when [A -|- B)“^ = 0) converges in a more general 
setting. We illustrate the somewhat surprising fact that if A and B are affine — but 
not normal cone — operators (see Example 4.8 1 , the sequence (/A7’”xo)n6]N can be 
unbounded. In fact, we can have ||/a7’”'^o|| even though the sum problem 


^Let w e X. We define the inner shift and outer shift of an operator T by if at x G X by T^x := T(x — w) 
and zvTx := —w + Tx, respectively. 

^Recall that T is non expa nsive if (Vx G X)(Vy G X) ||Tx —Ti/|| < ||x— 1 /||. 

^In highlight of Fact 2.2 the vector v is unique and well-defined. 
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has normal solutions p| T his illustrates that normal cone operators have additional 
structure that makes R2 possible. 


Organization 

The remainder of this paper is organized as follows. Section contains a collection of 
new results concerning nonexpansive and firmly nonexpansive operators whose fixed 
point sets could possibly be empty. Section focuses on affine nonexpansive operators 
and their corresponding inner and outer "normal" shifts. Various examples that illustrate 
our theory are provided. Section|^is devoted to present the main results. We prove strong 
convergence of the shadows of the Douglas-Rachford iterates of two (not necessarily in¬ 
tersecting) affine subspaces. 


Notation 

Let C be a nonempty closed convex subset of X. The recession cone of C is rec C := {x G 
X I X -|- C C C}, the polar cone of C is C® ;= {w G X | sup(C, U) < 0} and the dual cone of C 
is C® = — C®. When C is an affine subspace the linear space parallel to C is par C = C — C. 
Otherwise, the notation we utilize is standard and follows, e.g., ||5l and Il24l . 


2 Nonexpansive and firmly nonexpansive operators 

In this section, we collect various results on (firmly) nonexpansive operators that will be 
useful later. Let w G X. Recall that for a single-valued or set-valued operator T we define 
the inner shift and outer shift by w at x G X by 

(3) TyjX := T{x — w) and zvTx :=—w + Tx, 

respectively. 

Lemma 2.1. Let T : X —> X and let w G X. Then the following hold: 

(i) Fix(r_a;) = —w + Fix(w + T) = —wFix(_a,r). 

(ii) w G ran(Id—T) Fix(zt; T) 0 Fix(T_a;) 0. 

^The normal solutions are the counterpart of the best approximation solutions in the context of fhe 
normal problem 151 when fhe operators are nof normal cone operators (see Secfionj^for defails). 
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(iii) (Vx G X)(Vn G N) {T-y^Yx = —w + {w + TY(x + iv) = —w + {-y,TY{^ + w). 


Proof, (i) Let x G X. Then x G Fix(r_H;) 
^ X + w G Fix(ze + T) 


w 


X = T(x + w) 
X G —w + Fix(w + T). 


(ii) w G ran(Id — T) (3x G X) such that w = x — Tx 

X = w + Tx Fix(z(; + T) 7^ 0. Now combine with[(I)j 


X + w = w + T{x + 
(3x G X) such that 


(iii) We proceed by induction. The conclusion is clear when n = 0. Now assume that 


for some n G N it holds that + (w + r)"(x + w). Then (T_a,)”+^x = 

T{{T-igYx + w) = T{—w + (w + T)”(x + w)+w) = —iv + w+ T((zv + T)"(x + w)) = 
—w + (le + r)”+^(x + w), as claimed. ■ 


We recall the following important fact. 

Fact 2.2 (Infimal displacement vector). (See, e.g., B. HTTI and 1123 . 1 Let T : X ^ X be 

nonexpansive. Then fah(Id — T) is convex; consequently, the infimal displacement vector 


( 4 ) ^Prmiid-TY 

is the unique and well-defined element in f^(Id —T) such that ||v|| = inf ||x — Tx 


Unless stated otherwise, throughout this paper we assume that 

(5) T is a nonexpansive operator on X, 
and that 

(6) V := G ran (Id -T). 

In view of (|^ and Lemma 2.1we have 

(7) Fix(T_v) Y ^ Fix(v+T) Y 

We start with the following useful result. 

Lemma 2.3. Let C be a nonempty closed convex subset of X and let c ^ C satisfies that ||c| 
||PcO||- Then c = PcO. 


Proof See Appendix A 

Proposition 2.4. Let yQ G Fix(v+T). Then the following hold: 


(i) 1/0 “ IR+V U Fix(v+T). 
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(ii) Fix(v +r) - R+ V = Fix(v +7). 

(iii) —R+V C rec(Fix(v+r)). 

(iv) (Vn G N) r”i/o = yo “ ^ V. 

(v) ]—00, 1 ] -v + FixT-v C Fix(v+r). In particular it holds that Vix{T-^) C Fix(v+r). 

(vi) For every x G X, the sequence {T"x + nv)„(zfq is Fejer monotone with respect to both 
Fix(v +r) and Fix(r_v). 

(vii) Suppose that xq G FixT_v and set (Vn G N) = T^xq. Then Xn = xq — nv and 
{xn)neiN in Fix(r_v). 


Proof. First we use induction to show that 

(8) (Vn G N) 1/0 “ ^ V G Fix(v+T). 

Clearly when n = 0 the base case holds true. Now suppose that for some n G N it holds 
that yo — n V G Fix(v +T), i.e., 

(9) yo - n V = v+T(i/o - ?^v). 


Using Q and 0 we have 

||v|| < ||(Id-r)(i/o - {n + 1) v)|| = IIj/o - (n + l)v-T{yo - (n + 1) v)|| 

= IIj/o - v-T(i/o - (?^ + 1) v)|| = ||r(i/o - - T(i/o - (?^ + 1) v)|| < ||v 


Consequently all the inequalities above are equalities and we conclude that ||v|| = ||yo — 
(n + 1) V —T(i/o ~ (^ + 1) v) II. It follows from 0 and Lemma [2^ that 

(10) yo - (n + 1) v-T(yo - (?^ + 1) v) = V. 


That is, yo — (n + 1) V = v +T(yQ — (n + l)v), which proves 0. Now using [[5i Corol¬ 
lary 4.15] we learn that Fix(v -|-T) is convex, which when combined with 0 yields [(I)| 


(ii) On the one hand it follows from (i) that Fix(v +T) — R-|- v C Fix(v +T). On the 


other hand Fix(v +T) = Fix(v +T) — 0 • v C Fix(v +T) — R+ v. 


(iii) This follows directly from|(ii)[ 


(iv) We use induction. Clearly yp — 0 v = yo 


it holds T”yo = yo — nv. Using (i) we have T 
yo - {n + 1) V. 


= T^yo- Now suppose that for some n G N 
"+iyo = r(yo-nv) = -v+yo-nv = 
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(v) Using Lemma 2.]|^ and (i) we have ] —oo, 1] • v + Fix T_ v = v —R+ v + Fix T_ v = 
Fix(v+T) — R+v = Fix(v+7^ In particular we have Fix r_v = O-v + FixT-v U 
Fix(v+r). 


(vi): Let x G X and let y G Fix(v +T). Then using (iv) we have for every n G N, 


||r"+ix + (n + l)v-y|| = ||r"+ix- (y- (n + l)v)|| = \\T’^+'^x - T^+^y\\ 

< ||T”x — r”y|| = ||r”x — (y — nv)II = ||r”x + nv —y||. 

The statement for Fix T-v follows from|(v)| 


|(vii)[ Combine (v) and (iv) to get that x„ = xq — nv. Now by Lemma 2.]|(i)| xo + v G 
Fix(v +T). Using (i) we have (Vn G IN) xq + v— nv G Fix(v+r) or equivalently by 
Lemma 2.]|^ xq — nv G —v + Fix(v +T) = Fix(r_v). ■ 


The next example is readily verified. 

Example 2.5. Let C be a nonempty closed convex subset of X and suppose that T = Id— Pc- 
Then T is firmly nonexpansiv^and v = PcO. Let x G X. Then x G Fix(v +r) PqX = v, 

while X G Fix T_ v Pc{^ + v) = v. 

Proposition 2.6. Suppose that X = R, and that Fix T = 0. Let x G R and set (Vn G N) y„ = 
T”x + n V. Then the following hold: 


(i) {yn)neiN converges. 

(ii) R ^ R : X H-^ lim (r”x + n v) is nonexpansive. 


w —>00 


(hi) Suppose that T is firmly nonexpansive. Then R 
nonexpansive. 


R : X HG lim (r”x + n v) is firmly 


n^oo 


Proof, (i) In view of Proposition 2.4 Vi) the sequence (y«)n6N is Fejer monotone with 
respect to Fix(v+r). Now by Proposition 2.4 4) we know that Fix(v+T) contains an 


unbounded interval. Since X = R we conclude that tntFix(v+r) 0. It follows from 
||5l Proposition 5.10] that {yn)nelN converges. 


(ii) Let y G R. Then 


lim (T"x + n v) — lim (T”y + n v) = lim (T”x + n v —T"y — n v 


n^oo 


n—>-00 


n—)-oo 


( 11 ) 


= lim |r”x — r”y| < lim |x — y| = |x — y|. 

n—)-oo n—)-oo ^ 


^Recall that T: X —> X is firmly nonexpansive if (Vx e I^)(Vi/ e X) ||Tx — Ty\\^ + ||(Id—T)x — 
(Id-T)y||2 < \\x-yf. 
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(iii) It follows from ||5l Proposition 4.2(iv)] that an operator is firmly nonexpansive if and 


only if if is nonexpansive and monotone. Therefore, in view of (ii) we need fo check 
monotonicity Without loss of generality let y G R such that x < y. Since T is firmly 
nonexpansive, hence monotone, one can verify that (Vn G IN) T^x < T^y and therefore 
(Vn G N) + n V < r"y + n v. Now take the limit as n —> oo. ■ 


When X = R, it follows from Proposition 2.^|[i)| that the sequence {T”x + n v)„g]N con¬ 
verges. In view of Proposition 2.4 |[vi) the sequence (r”x -|- n v)„£]n is Fejer monotone with 
respect to Fix(v +T) which might suggest that the limit lies in Fix(v -|-T). We show in the 
following example that this is not true in general. 

Example 2.7. Suppose that X = R and that 

{ X — a, if X < a; 

0, if a < X < /3; 

X — /3, if X > /3, 

where 0 < a < ^. Then T is firmly nonexpansive but not affine, v = x, Fix(v +T) = ]—oo,x]. 
Fix r_ V = ] —oo, 0] , and 

/ 


(13) T” + nv : R ^ R ; X ^ 


X, 

X, 

X — n(/3 — x), 
min I X, X — | /3 1 


+ 


X, 


Consequently, 

(14) lim (T" + nv) :R^R:xi-g 


n^co 





if X < x; 
if X < X < /3; 

if X > /3 and n < [x//3J; 
if X > j6 and n > [x/j6j. 


if X < x; 
if X < X < / 3 ; 
if X > / 3 . 


+ X 


Therefore for every xq G R the sequence (T”xo + n v)neK eventually constant. However, if the 
starting point xq lies in the interval ]f,oo[, then lim„^.oo T”xo + n v = min{x,x — + 

S?Fix(v+T). 


Proof. See Appendix B[ 


3 Affine nonexpansive operators 


In this section, we investigate properties of affine nonexpansive operators. This additional 
assumption allows for sfronger results than those obtained in the previous section. We 
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recall the following fact. 

Fact 3.1. (See JS! Proposition 3.17].) Let S be a nonempty subset ofX, and let y G X. Then 
(15) (Vx G X) Py+s^ = y + Ps{^-y)- 

Theorem 3.2. Let L: X ^ Xbe linear and nonexpansive, let b ^ X, and suppose that T: X —^ 
X: X Lx + b. Suppose also that v G ran(Id —T), and let x G X. Then the following hold: 

(i) V = PFixL(“^) £ FixL = (ran(Id —L))-*-, and V 7 ^ 0 &^ran(Id—L). 

(ii) (Vn G N) r”x = L”x + 

(iii) (Vn e N) r”j: + n V = L”x + L*P„„(H -L)J>- 

(iv) (Vn G N) (r_v)”x = T^x + nv. 

(v) (Vn G N) (r_v)”x = (v+r)"x. 

(vi) Fixr_V = - V + FixT_V = - V + Fix(v +T) = Fix(v +T). 

(vii) Fix(r_v) = Fix(v+r) = ]Rv + Fix(v+r) = Rv + Fix(T_v). Consequently v lies in 
the lineality space o/Fix(T_ v) = Fix(v +r). 


Proof, (i) Note that ran(Id —T)= ran(Id —L)—b and hence ran(Id —T)= ran(Id —L) — 
b. Therefore, using Fact 3.1 


we have v = F, 


ran(Id — T) 


0 = F 


—b+ran(Id —L) 


_f.^0 = -b + 


Fran(id-L)(0 - (-^)) = -^Ffan(id-L)^- Using ||5] Fact 2.18(iv)] and (B Lemma 2.1], 
we learn that ran (Id —L)"*" = ker(Id —L*) = Fix L* = Fix L, and hence 


^ L)) ( F(^ran(Id —L))J 

Note that V 7^0 b ^ ran(Id —L). 


:-b) = Pm.L{-b). 


(ii) We prove this by induction. When n = 0 the conclusion is obviously true. Now 


suppose that for some n G N it holds that 


w —1 

(17) r"x = L"x + ^ L^b. 

k=o 

Then T”+ix = T{T^x) = T{L^x + ElZi L'^b) = L{L^x + L’^b) + b = L^+h + 

Ylk=o as claimed. 

®For the definition and a detailed discussion of fhe linealify space, we refer fhe reader fo Il23l page 65]. 
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(iii) Note that b = ffan(id-L)^ + ^FixL^- Using [(i)| and |(ii)|yields 


T”x + n V = L”x + {L^b + v) = L”x + ^ + L^v 

k=o k=o ^ 


n—1 


n—1 


= L«x+ E (L^&-UPFi,LM = L«X+ U(Id-PFixL)& 
k=0 ^ ^ fc=0 


L"x+ i^^Jkn(Id-L) 

k=0 


b. 


(iv) We prove this by induction. Note that by [^v G FixL, hence Lv = v. When 
n = 0 we have (T_v)®x = x = P^x + 0 • V. Now suppose that for some n G IN it holds 
that (T-v)”x = r”x + nv. Then (r_v)”^^x = r_v(T”x + nv) = r(r”x + nv + v) = 
L(r”x) + L((n + 1 ) v) + = r”+^x + (n + 1 ) v. 


(v) We use induction again. The base case is obviously true. Now suppose that for 
some n G IN it holds that (v +r)”x = T^x + nv. Then (v +r)”"'"^x = v +r(v +T)”x = 
v+r(r”x + nv) = v+L(r”x + nv) + b = v+LT^x + nv+b = LT^x + b + {n + l)v 
= T”+^x + (n + 1) V. Now combine with (iv) 


|(vi)[ Using[(^with n = 1 we have T-^ = v +T. Now apply Lemma 2.1 


(vii) Using (vi) and the assumption that T is an affine operator, we have Fix(r_v) = 
Fix(v +T) is an affine subspace. Now let yo G Fix(T_v) = Fix(v+T). Using Propo- 
2.4^ we have —R-|_ v C Fix(v+r) — yo = parFix(v+r) and therefore Rv C 


sition 


parFix(v +r). Hence yo + Rv C Fix(v+r) which yields Fix(v+T) + Rv C Fix(v+T). 


Since the opposite inclusion is obviously true we conclude that (vii) holds. 


Suppose T is nonexpansive but not affine. Theorem |3^ might suggest that, for ev¬ 
ery X G X, the sequences (T”x + and ((v+T)”x)^gj^ coincide, and 

consequently (r”x -|- is a sequence of iterates of a nonexpansive operator. Inter¬ 

estingly, this is not the case as we illustrate now. 

Example 3.3. Suppose that X = R and let ^ > 0. Suppose that 


(18) 


T: R —R : X H- 


X — /3, X < |6; 


X (x — |6), X > |6, 
where 0 < x < 1. Then Fix T = 0, v = j6,/or every n G N 
(19) (T-v)^ : R —^ R : X H- > x" max {x,0} min {x,0} , 


( 20 ) 


(v-l-T)” : R —R : X H- x” max {x — /3,0} -|-min {x, j6} , 


10 





















ciyii^ 


X, 


(21) r" + nv:R^R:x^ 


a;”x — 


a(l—a”) 
l — OL 


/3 + n/3, 

q{x)^ _ ( a(l-^?W) \ ^ ^ q{x)^, 


if X < /3; 

if X > |6,n < q(x); 
if X > /3,n > q{x), 


where q{x) : R 

( 22 ) 


N : X ^ log^ . Consequently, 

(Vx G R) lim (r_v)” X = min {x,0} , 


n^co 


(23) 

und 


(Vx G R) lim (v+T)"x = min{x,/3}, 


(24) (Vx G R) lim (T”x + nv) = 


M —>00 


if X < /3; 

t?(^)x - ifx>|6. 


Moreoz;er, ftere is no operator S : R —> R sucfz that for every x G R and for every n G N zoo 
/zfloo S”x = r”x + n V. 


Proof See Appendix C[ 



Figure 1: The solid curve represents lim„^.oo(T_v)”x, the dashed dotted curve represents 
lim„^.oo(v +r)”x, and the dashed curve represents lim„^.oo T”x + n v, when x = 0.5 and 
/3 = 1. 
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Figure provides a plot of the functions defined by (22), (23) and (24) fhaf illusfrates 
thaf fhey are pairwise disfincf. 


4 The Douglas-Rachford operator for two affine subspaces 

Unless otherwise stated we assume from now on fhaf 

A and B are maximally monofone operafors on X. 

The Aftouch-Thera dual pair of {A,B) (see 111) is the pair (A,B)* := {A~^, B“®), where 

(25) A® ;= (-Id) o Ao (-Id) and A“® ;= (A“^)® = (A®)“^. 

We shall use 

(26) Z:=Z,^,b) = (21 + B)-'(0) and K := = (A”'+ B-®)-'(0), 

to denote the primal and dual solutions respectively (see e.g. Iffll. 

The normal problem associated with the ordered pair (A, B) (see |j8|) is to find x G X such 
thaf 

(27) 0 G vAx + BvX = Ax — v +B(x — v), 
where 

( 28 ) ^ 

and T = T'[a,b) is defined by ([^. We recall (see (TSl Lemma 2.6(iii)] and lH Corollary 4.9]) 
that 

(29) Z = /a (Fix T) and K = (Id -Ja) (Fix T), 

and that T is self-dual (see IIT^ Lemma 3.6 on page 133] and HI Corollary 4.3]), i.e., 

(30) = P{A,B)* = P{A-\B-&)- 

The normal pair associafed wifh fhe ordered pair (A, B) is the pair (vA, B^) and the normal 
Douglas-Rachford operator is Using ||8l Proposition 2.24] we have 

(31) 'P{yA,BA = P-v- 

The set of normal solutions is Zv := Z(^^ g^) and fhe set of dual normal solutions is := 

^(vXBv)- 
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Lemma 4.1. The following hold: 


(i) Z. = /,^(Fix{T_,)) = = /^(Fix{T_,) +v) = /^{Fix(v+T)). 

(ii) Ky = (Id-/,4)(Fix(r_v)) = (M-/,_v+a))(Hx(T_,)). 

(iii) Ky 0 Zv 7 ^ 0 V G ran(Id—T). 



In the following we assume that 
(32) V = G ran (Id -T), 


that 

(33) U and V are nonempty closed convex subsets of X 
and that 

(34) A = Nu and B = Ny 
Using US, Example 23.4], Q becomes 

(35) Tuy := = Id -Pu + PyRu^ 

where Ru = 2Pu — Id. In this case (see ||8l Proposition 3.16]) 

(36) V = Pjj_yO, 
or equivalently 

(37) -V G Njjirp(v). 

The normal problem now is to find x G X such that 

(38) 0 G Nijx — V+Ny(x — v). 

Lemma 4.2. Let w G X. Then the following hold: 
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(i) }-zo+Nu = }Nui- + W) = Pu{- + W). 

(ii) }nu{-w) = w + /nu(- - w) = w + Pu{- - w). 

(iii) Nv{--w) = Nu,+v- 

(iv) Suppose that U is an ajfine subspace and and that lu G (parLT)-*-. Then (Vo: G R)(Vx G X) 
P(j(x + a;w) = Pjjx. 



Proposition 4.3. Suppose that U and V are closed affine subspaces of X and that T = Tuy. 
Then the following hold: 


(i) r is affine and T = Id—Pjj — Pv + '^PyPu- 

(ii) V G (parLT)-*- n (pary)-*-. 

(iii) (Vx G X) (Va G R) Pux = Pu{x + a v). 

(iv) (Vx G X) (Vx G R) Pyx = Py(x + X v). 

(v) r_v = V +T = T]Vy,N^(._v) = Tu^y+v 

(vi) Zv = Un{v+V). 

(vii) Xv = (par Li)-*- n (parR)-*-. 

(viii) Fix(T_v) = Fix(v+r) = = {U Ci (v+R)) + ((par Li)-^ n (par R)-^). 


Proof (i) Note that Ja = Pu arid Jb = Pv are affine (see e.g. BH, Corollary 3.20(i)]). Using 

Since the class of 


we have T = Id —Pjj + Pv{2Pu — Id) = Id —Pu + IPyPu — Py. 
affine operators is closed under addition, subtraction and composition we deduce that T 
is affine. 


(ii) It follows from |j6l Proposition 2.7 & Remark 2.8(ii)] that v G (rec Li)® H (rec R)® = 
(par Li)® n (par R)®, where the last equality follows from ||5l Proposition 6.22 and Propo¬ 
sition 6.23(v)]. 


(iii) and (iv) Combine 

(ii) 

with Lemma 

4.2 iv) 
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(v) It follows from (iv) with a replaced by —1, and Lemma ’ii) that = 

v+Py(- — v) = v+Py. Consequently, using Theorem ^V) aridni^ we have T_ 


v+T = Id-Pu + ^+PyRu = 

'^Nu,Ny(-—v) '^N[j,Nv+y '^Lf,V+y- 


T 


Nu,Ny(-v)- 


Finally, Lemma 


.2 'iii) implies that 


(vi) See IP Proposition 3.16]. 


(vii) Let z G U (1 (v +V) = Zy and note that, as subdifferential operators, Njj and 


Ny are paramonotone (see, e.g., H201I ) and so are the translated operators — v +Nu and 
Nv{- — v). Therefore, in view of 21 Remark 5.4] and (ii) we have 


(39) 


Kv = (-v+Njjz) n {-Ny{z - v)) = (-v + (par n (par 

= (parLf)"*" n (parP)"*". 


(viii) Since — v +Nu and Ny{- — v) are paramonotone, it follows from (v) (vii) and (H 
Corollary 5.5] applied to the normal pair (yA, By) that Fix(r_y) = Fix(v +r) = Zy + Ry. 
Now combine with |(vi)| and |(vii)[ ■ 


We are now ready for our main result. It illustrates that, even in the inconsistent case, 
the "shadow sequence" (P(jr”x)„£]N behaves extremely well because it converges to a 
normal solution without prior knowledge of the infimal displacement vector. The proof of 
Theorem |4.4| relies on the work leading up to this point as well as the convergence analysis 
of the consistent case in |l3l. 


Theorem 4.4 (Douglas-Rachford algorithm for two affine subspaces). Let x G X. Then 
(Vn G N) zee have 

(40) PuT'^x = Pu(T^x + nv) = Pu((r-v)"x) = PuTl}^,+y = /-y+Nu((T-y)”x), 
and 


(41) PijT^x ^ Pz,x = Puniv+v)X- 

Moreover, if par U + par P is closed (as is always the case when X is finite-dimensional) then the 
convergence is linearnwith rate being the cosine of the Friedrichs angle 

(42) Cf(parLf,parP) := sup \{u,v)\ < 1, 

i;6par (JnW^nball(0;l) 

D6par VnW-'-nbal^O;!) 

where W = par U n par P and ball(0; 1) is the closed unit ball. 

^Recall that —)• x linearly with rate 7 e ]0,1[ if ( 7 “”||x„ — x||)„g]N is bounded. 
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Proof. Let n G IN. Using 4.c 'iii) with (x, a) replaced by {T^x,n) we learn that 


PjjT^x = Pu(r”x + n v). Now combine with Theorem 3.2 |[iv) to get the second iden¬ 
tity. The third identity follows from applying Proposition 4.3|[v) Finally note that using 
the first identity, O'iii) with (x,a.) replaced by ((T_ v)”x, 1) and Lemma 4.2 4) we learn 
thatPjjT’^x = Pij({T-y)^x + v) = /_v+Nu_(( 7’- Now we prove (|4T|. It follows from 


, Lemma 4.1 'hi) and Proposition ^Vi) that Zv = Un (v-|-U) 7 ^ 0 . Now apply El 
Corollary 4.5]. ■ 



Figure 2: Two nonintersecting affine subspaces U (blue line) and V (purple line) in R^. 
Shown are also the first few iterates of (r”xo)n 6 N (green points) and {PuT^Xo)neK (red 
points). 


Figure]^ shows a Geogebra snapshot IIT^ of the Douglas-Rachford iterates and its shad¬ 
ows for two nonintersecting nonparallel lines U and U in R^. 


'The following result is known (see e.g., ffTTl Corollary 1.5] and ||2j Corollary 2.3]). We 


include a simple proof for completeness in Appendix D 


Proposition 4.5. Suppose that T : X —> X be firmly nonexpansive, and that v = Ffan(id-T)0 ^ 
ran(Id—T). Then 


(43) 


(Vxgx) r"x-r”+ix^v. 
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Proposition 4.6 (When only one set is an affine subspace). Suppose that U is an affine sub¬ 
space of X, and that T = Tuy. Then for every X G X the sequence {P]jT^x)neK^s asymptotically 
regular, i.e., PuT^x — > 0. 


Proof Using Remark 2.8(ii)] we have v G (parU)-*-. It fo llows from Lemma 4.2 iv) 
applied with {x,x) replaced by (r”+^x, 1) and Proposition |4^ that 


(44) ||Pur"x - PuT"+U|| = ||Pur”x - Pu(T"+^x + v) 
as claimed. 


< ||r”x- p 


M + l 


X — V 


0 , 


Example 4.7. (The dual shadows) Consider the case when U and V are affine subspaces of 


X such that U CiV = 0. Set A := Njj^ and B := N 


and using (30 


we have T, 


= T, 


Then A 


-1 _ 


^ . ...... = Nu. B-® = Nv, 

= T(j,y. Moreover the inverse resolvent identity 


{A,B) -"(A-kB- 

(see, e.g., liMf Lemma 12.14]) implies that (Vx G X) JffT^x = (Id—P(j)T”x = T"x — PuT^x. 
Note that K = U CiV = 0, hence by (291 and (301 FixT^^^g^ = 0. Using /l22l Corollary 6(a)] 

Moreover, in view of ([^, using 


oo. 


we learn that for every x C X we have ||r”x 
Theorem 3.13(iii)] we know that for every x C X we have {PuT^x)ne]N a bounded sequence. 
Therefore, ||/^r”x|| = ||r"x - Pur"x|| > ||T"x|| - ||PLfP”x|| ^ oo. 


We conclude with the following example which shows that for two affine (but not nor¬ 
mal cone) operators the shadows need not converge. 

Example 4.8. Suppose that X = Wf and let S : ^ : (xi,X 2 ) i—> (—X 2 ,Xi), be the 

counter-clockwise rotator by 7r/2. Let & G R^ \ {(0,0)}. Suppose that A := S and set B := 
—S b. Then zer A 0, zer B 0 yet zer(A -|- B) = 0. Moreover, v = (Id -|-S) {b), the set 
of normal solutions = R^ and for every x G R^ zf e have ||/, 4 r”x|| —^ oo. 

Proof. Let x G R^ and note that S and — S are both linear, continuous, single-valued, 
monotone and = {—Sff = —Id. It follows from (HI Proposition 2.10] that J^x = 
Jsx = 2 (Id —S)x = ^{x — Sx). Similarly using 0 Proposition 23.15(ii)] we can see that 
/gx = |(x — b Sx — Sb). Therefore we have R^x = —Sx and Rgx = —b-\-Sx — Sb. 
Hence RbRax = S(—Sx) — Sb — b = —S^x — Sb — b = x — Sb — b = x — {ld+S)b. 
Consequently we have 

(45) (VxgR^) Tx=^{ld+RBRA)x = x-l{ld+S)b. 



which completes the proof. ■ 
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Appendix A 


Proof of Lemma 

PcOf < ||c- 

ll^'cOf = 0. 


2.3 


Using that Pq is firmly nonexpansive we have ||c — EcOp 
- ||(Id-Pc)c - (Id-Pc)Of = ||c||2-||c-Pcc + EcOf 



Appendix B 


Proof of Example [Z7| Clearly 


(46) 


{ a, if X < a; 

X, if x < X < /3; 
f, if X > f. 


Therefore, ran(Id —T) = [a, f], and consequently v = x. Moreover 

(47) (Vx G R) X > Tx -|- X > T^x -|- 2x > • • • > r”x + nix > • • • . 
It is clear from Example |2.5| that 

(48) Fix(v+T) = ] —oo,x]. 


The statemenf for Eix T_ v then follows from combining (|48]) and Lemma |2T 1) The con¬ 
vergence of the sequence follows from Example 2.5 or Proposition |2.6|[i)| Now we prove 
(0. We claim that 
(49) 


T" : R ^ R : X ^ 


"x — nx, 

(1 — n)x, 

a 

X — np, 


min 



X 

h 



if X < x; 
if X < X < j6; 

if X > /3 and n < [x//3J; 
if X > /3 and n > [x//3J. 


Using induction it is easy to verify the cases when x < x and when a < x < f. Now we 
focus on the case when x > /3. Set 


(50) 


K := [x/ p\ and r := x — Kf, 
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and note that x = i<C/3 + r, K e {1,2,3,...} and 0 < r < /3. In view of (47), if n G 
(0, 1,2,3,... ,K} we get T^x = x — nfi = (K — n)/3 + r. In particular. 


(51) 


T^x = X — [x//3j /3 = r. 


If n > fC we examine fwo cases. Case 1: 0 < r < x. If follows from (|5p and ( [l^ that 
(Vn > K) r”x = r + {K — n)a. Case 2: a < r < /3. Note that T^~^^x = 0, therefore using 
( [^ and (12) we have (Vn > K) T^x = {K + 1 — n)(x = a. + {K — n)a., which proves ( [4^ . 
Now (13) follows from (j4^ because v = a. Letting n —^ oo in ( [T^ yields ( [14] ). Note that 
mtn{a;,x — ^ 0 [|J > 1. By considering cases {K = 1 and K > 1), (14) implies 

thatlim„^oo(L”xo + nv) = min{a;,x — jf3} + x > a ^ ]—oo,a;] = Fix(v +7). 


Appendix C 


Proof of Example [3Jj Considering cases, we easily check that 

(52) Id — T: IR —^ R : X HG (1 — x) max (x,/3} + x/3 > /3 > 0. 

Hence Fix T = 0 and V = j6 as claimed. Moreover, using ( |52| ) one can verify thaf 

(53) (VxgX) x> rx + |6> ••• > r"x + n^> r"+ix+(n + l)^> ••• . 


We also verify fhaf 

(54) (Vx G R) T_v : R —> R : X HG max {x,0} X + min {x,0} . 

We now prove ( |T^ by induction. Lef x G R. 

Clearly when n = 0 the base case holds true. Now suppose that for some n G IN (g 
holds. If X < 0 then (T_v)”x = x < 0, and therefore, (54) implies thaf (r_v)”^^x = 
T_v((7_v)”x) = r_vX = X. Similarly we have x > 0 ^ x"x = (T_v)”x > 0, and 
consequently (54) implies that (T_v)”^^ X = T_v((7_v)”x) = r_v(x”x) = x”"'"^x. The 
proof of (20) follows from combining (19) and Lemma 2.1 [iii) Now we turn to ( |2T| ). We 
consider two cases. 

Case 1: X < j6. It is obvious using the definition of T thaf (Vn G IN) r”x = x — nf. 

Case 2: X > /3. Let n G N be such that T”x > /3. By (j^ and ( jlSj ) we have 


r«+ix = x"+^x - (x”+i + x" H- h x)|6 = X 


1 — X 
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(55) 


^ ^n+l f (1-^)X + 0C^ 

1 — a 


1 — a 




In view of ( |53| > there exists a unique integer, say, q{x) G {1,2,...} that satisfies > 

/3 and < /3. Since 0 < a < 1, using (551 we have 




a 


a 




q{x) ( il-x)x + IX^ \ _^ 

1 — X ) 1 — X 

q{x) ( {1-X)X^X^ I ^ 

/3 


'?(*) < 


/3</3 

^ ^^ {{1 — x)x + x^) < ^ 

/3 


(1 — x)x + x(i 


1 — X 
^ qix)> log^ 


x(i + {1 — x)x’ 


Consequently, q{x) = log 


a a/3+(l—a)x 


. At this point, since < j6, we must have 

(Vn > q{x)) r”x = r'?(^)x — (n — q{x))fi, which proves (211. The formulae (22), (23) and 
( [M] ) are direct consequences of ( [T^ , ( [^ and (21), respectively To prove the last claim 
note that if S : R —^ R is such that for every n G IN we have S" = T” + n v, then setting 
n = 1 must yield 


(56) S = V +T : R ^ R : X HG 

Now compare ([^ and ([^. 


X, X < /3; 

X (x — /3) + /3, X > /3. 


Appendix D 


Proof of Proposition 4.5 Let yo G Fix(v +T) and note that Proposition 2.4 Iv) implies that 
(Vn G N) (Id—T)T”i/o = v. Since T is firmly nonexpansive, it follows from Proposi¬ 
tion and © Proposition 5.4(ii)] that 


T"x- r"+ix-vf = ||(id-r)r"x- (id-r)r”yol 


'«+i 


x-r+Vol 

'W + 1, 


< ||r"x- r"yoll - II r 

= ||T"x nV —yoll^ — ||r"+-^x + {n + l)v —yoP —> 0. 
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